Papers with statistical tool
The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing (P18-1)
Copied to clipboard
| Challenge: | Statistical significance testing is a standard statistical tool designed to ensure that experimental results are not coincidental. |
| Approach: | They propose a protocol for statistical significance test selection in NLP setups . they propose he proposes a survey of the most relevant tests to help guide the protocol . |
| Outcome: | The proposed protocol includes a survey of the most relevant tests. |
Model Criticism for Long-Form Text Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Language models generate fluent text, but it remains unclear whether output retains coherent high-level structure. |
| Approach: | They propose to use a statistical tool to evaluate high-level structure of text . they compare distributions between real and generated data in latent space . |
| Outcome: | The proposed model criticism compares distributions between real and generated data in a latent space . different generative processes identify specific failure modes of the underlying model . |